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We study the angular Fulde-Ferrell-Larkin-Ovchinnikov (FFLO) state, in which the rotation sym- 
metry is spontaneously broken, in population imbalanced fermion gases near the BCS-BEC crossover. 
We investigate the superfiuid gases at low temperatures on the basis of the Bogoliubov-de Gennes 
equation, and examine the stability against thermal fluctuations using the T-matrix approach be- 
yond the local-density approximation. We find that the angular FFLO state is stabilized in the 
gases confined in the toroidal trap but not in the harmonic trap. The angular FFLO state is stable 
near the BCS-BEC crossover owing to the formation of pseudogap. Spatial dependences of number 
density and local population imbalance are shown for an experimental test. 
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Superfluidity in cold fermion gases provides vast oppor- 
tunities to study novel quantum phenomena.'^' One of the 
goals of current studies is the realization of the Fulde- 
Ferrell-Larkin-Ovchinnikov (FFLO) stat^^ in popula- 
tion imbalanced superfluid gases.HEl FFLO superfluid- 
ity/superconductivity is attracting growing interest in a 
variety of fields, such as condensed-matter physics,'^ as- 
trophysics, and nuclear physics.'^ Since many parameters 
can be experimentally controlled cold fermion gases are 
promising candidates for the FFLO state.* ^ 

Spontaneous breaking of space symmetry is a charac- 
teristic feature of the FFLO state. However, no firm ev- 
idence has been obtained for the space symmetry break- 
ing in the condensed-matter physics. In contrast to the 
superconductors, the spatial structure of superfiuid is 
directly measured in cold atom gases. Therefore, it is 
highly desired to observe the space symmetry breaking 
due to the FFLO superfiuidity in cold fermion gases. 
While the translation symmetry plays a major role in 
superconductors, cold atom gases lack translation sym- 
metry owing to the trap potential. Instead, the rotation 
symmetry is well defined in the latter. The purpose of 
this Rapid Communication is to investigate the FFLO 
state which spontaneously breaks the rotation symme- 
try. 

On the basis of the mean-field Bogoliubov-de Gennes 
(BdG) equations, so me authors in vestigated the radial 
FFLO (R-FFLO) stat d^° ' " ' ^^ ' ^ -^in which the order pa- 
rameter changes its sign along the radial direction around 
the edge of the harmonic trap. However, no space sym- 
metry is broken in the R-FFLO state, and therefore it 
is di fficult t o distinguish it from the phase separated 
state.'^^'^^'^ In this Rapid Communication we show that 
the angular FFLO (A-FFLO) state with broken rotation 
symmetry is stabilized in the toroidal trap.^^^ Several ex- 
periments are proposed for an unambiguous evidence for 
the A-FFLO state. 

The superfiuidity has been realized in the i mbalanced 
fermion gases near the BCS-BEC crossover.l^I^ESlMII] 
However, that is not achieved in the BCS limit since 



the transition temperature is too small. Because 
the mean-field theory breaks down near the BCS-BEC 
crossover a theoretical treatment beyond the BdG 
equations is desired for the study of cold fermion gases. 
To this end, the local-densi ty approx imation (LDA) has 
been used in the literature .ISIiSIMiTl However, a theory 
beyond the LDA is needed to study the superfiuid phase 
with broken space symmetry. For these theoretical re- 
quirements we adopt the rea l-spac e self-consistent T- 
matrix approximation (RSTA).'23I211'phe reliability of the 
RSTA has been examined in the uniform system by com- 
paring it with the nonperturbative infinite-loop order 
theory.l^We found that the RSTA is quantitatively valid 
at least in the BCS side of BCS-BEC crossover. 

We here investigate the gases confined in the (quasi- 
) two-dimensional space. The two-dimensional gas is pro- 
duced in the pancake potential oj^ 3> w± with and uj±_ 
being the harmonic trap frequency along the axial and ra- 
dial directions, respectively. The one-dimensional optical 
lattice along the axial direction also produces the quasi- 
two-dimensional gas.^^ Since the fiuctuation completely 
suppresses the continuous symmetry breaking in one- and 
two-dimensional systems at finite temperatures, a weak 
three dimensionality is assumed to realize the state with 
broken space symmetry. The following calculation is car- 
ried out in the two-dimensional model for simplicity, and 
the singularity of the low-dimensional model is cut off by 
a phenomenological procedure. 

We adopt the lattice Hamiltonian given as 

H = -t J2 4,.cp,, + 5IC^(l^-^^o|)"Ai.)n,v 

+U^nf^,inf^2, (1) 
f 

where cr = 1,2 denote two hyperfine states, tq is the 
center of the trap, and nf_cr = ct^cp^a is the number op- 
erator of cr particles. We take the unit h = c = 1. The 
symbol < r, r' > denotes the summation over nearest 
neighbor sites. The chemical potential for a particles 
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is determined so that the number of each particle is TVo-. 
The particle number and the imbalance are expressed as 
AT = AT^ + iVa and F = (TVi ~ A^2)/(^i + iV2), respectively. 
The lattice model is adopted for simplicity, but the dis- 
creteness of the lattice is negligible since we assume a 
small particle density N/N\^ — 0.1, where A^l = L x L 
is the number of lattice sites. Therefore, the following 
results are valid for continuous systems without lattices 
in the two-dimensional space. Since TVl = 38 x 38 in our 
calculation, the particle number is iV 144. We take 
the unit of length d so that l/2mcP = t = 1, where m 
is the mass of atoms. We define the Fermi energy as 
Ef = n — Eq, where £o is the energy of the lowest eigen- 
state and jj, is the chemical potential at P = and U = 0. 
We find that the superfiuidity is the leading instability 
and no spin/charge density wave occurs in this model. 

The last term of Eq. (1) describes the s-wave attrac- 
tive interaction. We assume U/t — —5, which leads to 
U/ef — —3.1. The BCS-BEC crossover is characterized 
in the two-dimensional system through the two-particle 
binding energy Cb rather than the three-dimensional scat- 
tering length Qs^^ In the uniform system, the binding 
energy is related with the chemical potential shift as 
A/z = /X — /LtQ = — where /xq is the chemical potential 
shifted by the Hartree term. The order parameter is de- 
scribed as Ao = \/2eb£F- Our calculations of A/i and Aq 
consistently lead to ~ 0.43eF for U/t — —5. Since the 
BCS-BEC crossover occurs around Cb ^ ep, our model 
is close to the BCS-BEC crossover slightly in the BCS 
side. The binding energy eb and effective interaction U 
are related with the three-dimensional scattering length 
fls through the confinement length — l/^mw^.'^ 

The trap potential is assumed to be V{r) = 
^0Jho{r / ro)'^ + Wtr exp(— r/^). This potential describes 
the harmonic trap for Wtr — and the toroidal trap for 
ujti 7^ 0. We found that the A-FFLO state is unstable in 
the harmonic trap in the whole parameter range. There- 
fore, we here show the results for the toroidally trapped 
system with = 12, Wtr = 8, and ^ = 5. The A-FFLO 
state is stabilized for any wtr/t^ho > 0, whose reason will 
be discussed later. 

We first analyze the model within the mean- 
field BdG equation and later investigate the 
role of thermal fluctuations on the basis of the 
RSTA. We obtain the mean-field Hamiltonian of 
BdG equations as = I]<r,P>,CT 4,aCp.CT + 

X;?,^ W^^(^"-r,rT,-Er-[^W4l42 + ^.c], whcrC 

W,\r) = V{\f- ro\) + Un-,{r) - a = 3 - a, 
ncr{r) —< np^cr >, and A(r) — U < ^,10^ .2 >■ The 
unphysical ultra-violet divergence in A{fj^^is naturally 
cut off since we adopt the lattice model. We numerically 
determine the stable phase by comparing the free energy 
of self-consistent solutions for ncr(r) and A(r). 

The RSTA has been formulated for the inhomogeneous 
superconductors.'^^'^ The Green's function G°'(r, r',w„) 
and the T-matrix T(r, r') are obtained by the following 



self-consistent equations: 

G^(r,r2,a;„)S^(f2,f3,c^„)G"^(f3,r',c^„), (2) 

r2,r3 

S"(r, r', cjn) = Un-,{r)5pp - TU^T{r, r')G^{r', r, -cj„), 

(3) 

r(r, P) = To(r, ?) - UToif, 7^2)^2,?), (4) 
n{ry) = TYG\?y ,u;n)G\T,? (5) 

where Go(r, r',w„) is the Green's function for f/ = 0, 
LJn — (2n -|- l)7rT is the Matsubara frequency, and T 
is the temperature. The thermal fluctuation, which is 
neglected in the BdG equations, is taken into account in 
the self-energy S'^(r, r',w„) in the one-loop order. The 
pseudogap in the single-particle excitation as well as the 
shift in chemical potential are taken into account in the 
RSTA. The former is neglected in the often-used Nozieres 
and Schmitt-Rink theory.l^Sl We show that the pseudogap 
plays an essential role for the stability of A-FFLO state. 

The quantum fluctuation is ignored in the RSTA, and 
therefore the RSTA is valid at flnite temperature around 
Tc.l^ Therefore, the RSTA is used to determine the in- 
stability to the superfluid state. The Tc is determined 
by the Thouless criterion. The maximum eigenvalue of 
|C/|To(r, r'), namely, Al, is unity at T = T^. Since the 
true long-range order does not occur in finite systems, 
we adopt the criterion Al = 1 — = 0.98 for Tc below 
which the long-range coherence develops. The singular- 
ity due to the one or two dimensionalities is also cut off 
by this procedure. The following results are not qualita- 
tively altered by the choice of (5l. This means that the 
following results are not sensitive to the three dimension- 
ality which is phenomenologically taken into account by 
a finite The density of states (DOS) for particles a 
is obtained as p'^(w) = ~:^^^pluiG'^^{r,f,Lo), where 
G'^^{r, f, uj) is the retarded Green's function. The total 
DOS is expressed as p{ui) = p^{uj) + p^{uj). 

We first discuss the results of BdG equations. Al- 
though the quantitatively reliable result is not obtained 
near the BCS-BEC crossover, the properties of each 
phase, such as the local population imbalance, are cap- 
tured by the BdG equations. We here study the spa- 
tial structure of several superfluid phases. Figure 1 
shows the phase diagram in which BCS state, R-FFLO 
state, and A-FFLO state are stabilized. Since the BCS 
state smoothly changes to the R-FFLO state without any 
phase transition, we show the crossover line above which 
the superfluid order parameter changes its sign around 
the trap edge. With an increase in the population imbal- 
ance, the second-order phase transition occurs from the 
R-FFLO state to the A-FFLO state. Although the tran- 
sition temperature is significantly overestimated in BdG 
equations, the successive phase transitions from the BCS 
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FIG. 1: Phase diagram for the imbalance P and the reduced 
temperature T/ef- Phase boundaries obtained by the BdG 
equations are shown by circles, triangles, and diamonds. The 
BCS state, R-FFLO state, and A-FFLO state are shown in 
the figure. The phase diagram determined by the RSTA is 
shown by the squares and (purple) thin solid line. The A- 
FFLO state is stable above the thin solid line, while the R- 
FFLO or BCS state is stable below it. We fix the particle 
density N/N-l = 0.1 in all figures. 

(a) P=0 (b) P=0.21 (c) P=0.39 
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FIG. 2: Spatial dependence of superfluid order parameter 
A(r) at T/ef = 0.00062. (a) P = 0, (b) 0.21, (c) 0.39, (d) 
0.44, (e) 0.49, and (f) 0.69, respectively. 



state to the A-FFLO state are not altered by the fluctu- 
ations, as will be shown on the basis of the RSTA. 

We clarify the spatial structures of each phase in 
Figs. 2-4. First we show the order parameter for various 
imbalances in Fig. 2. Figure 2(a) shows the BCS state 
realized in the balanced gas. Figures 2(b) and 2(c) show 
the R-FFLO state in the imbalanced gases. The rotation 
symmetry is preserved in these states. As the imbalance 
is increased in these states, the width of superfluid region 
shrinks. This deformation is regarded as the self-one- 
dimensionalization of the superfluid along the angular 
direction and leads to the A-FFLO state for P > 0.43. 
Figures 2(d)-2(f) show the spontaneous rotation symme- 
try breaking in the A-FFLO state. Thus, the A-FFLO 
state is an analog of the (quasi-)one-dimensional FFLO 



(a)P=0.1 (b)P=0.21 (c)P=0.39 
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FIG. 3: Spatial dependence of local population imbalance 
ni{f) — n2(f). We assume P = 0.1 in (a). The other param- 
eters are the same as in Fig. 2. 



g^g^^^mmmmMMM u is known that the FFLO state 
is favored in the quasi-one-dimensional system because 
of the nesting of Fermi surface.!^ An important finding of 
this Rapid Communication is the spontaneous formation 
of quasi-one-dimensional superfluid in the toroidal trap 
without any fine tuning. This should be contrasted to 
the harmonic trap, in which the uniform one-dimensional 
superfluid is hardly produced. We found that the self- 
one-dimensionalization occurs and the A-FFLO state is 
stabilized for any value of wti/'^ho > 0. As the particle 
density decreases, the quasi-one-dimensional structure is 
enhanced, and therefore the A-FFLO state is favored. 
A similar spatial structure has been discussed within 
the purely one-dimensional model; however, the self-one- 
dimensionalization has not been noticed.l^ Although we 
investigate the gases in the (quasi-)two-dimensional trap 
for simplicity, the A-FFLO state will be stabilized by 
the self-one-dimensionalization in a more general three- 
dimensional trap too. 

Figure 3 shows the spatial dependence of local pop- 
ulation imbalance ni(r) — n2(r). While the population 
imbalance appears around the outer and/or inner edges 
in the R-FFLO state [Figs. 3(a)-3(c)], the spontaneous 
rotation symmetry breaking is clearly shown in the A- 
FFLO state [Figs. 3(d)-3(f)]. A clear four-fold anisotropy 
is shown in Fig. 3(d), while the spatial dependence is 
smeared with an increase in the imbalance, as shown in 
Fig. 3(f). Thus, the features of the A-FFLO state are pro- 
nounced near the phase boundary to the R-FFLO state. 
A characteristic feature of A-FFLO state also appears in 
the particle density ni(r) -I- n2(r) as shown in Figs. 4(d)- 
4(f). The particle density decreases around the spatial 
nodes to gain the condensation energy. Owing to the 
spontaneous symmetry breaking, many A-FFLO states 
with different nodal directions are essentially degenerate. 
This degeneracy is slightly lifted by the lattice in our cal- 
culation. We show the most stable states in Figs. 2-4. 

We here turn to the results of RSTA, and discuss the 
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FIG. 4: Spatial dependence of particle density ni{r) + n2{r). 
The parameters are the same as in Fig. 2. 




FIG. 5; (a) Total DOS p(uj) in the balanced gas (P = 0) at 
T/ef = 0.074. (b) Spin resolved DOS p'^(lj) in the imbalanced 
gas (P = 0.4) at T/ef = 0.028. Sohd and dashed hnes show 
the DOS for a = 1 and 2, respectively. Thick lines show the 
results of RSTA, while thin lines are obtained by the mean- 
field theory for the normal fluid with A(r) = 0. 



roles of the thermal fluctuation. The phase diagram is 
shown in Fig. 1 and is compared to the mean-field BdG 
equations. According to the RSTA, the phase transition 
to the A-FFLO state occurs above P = 0.35, although 
the Tc is decreased by the fiuctuation. This means that 
the A-FFLO state is stable a gainst the fluctuation, in 
contrast to the previous studies.lS^We see the stability 
of the A-FFLO state because the phase diagram is plot- 
ted for the imbalance P, but not for the "magnetic fleld" 
/ii — /i2. The A-FFLO state seems to be suppressed by 
the fluctuation when the phase diagram is plotted for the 
"magnetic fleld" as in the studies of superconductors.^ 
The relation between the "magnetic fleld" /ii — fi2 and 
the imbalance P is affected by the pseudogap. In Fig. 5 
we see the decrease in DOS around uj — 0, namely, the 
pseudogap. The "magnetic fleld" for a flxed imbalance is 
increased by the pseudogap since the "spin susceptibility" 
X — P/ifJ-i — M2) decreases. The large "magnetic fleld" 
leads to the large splitting of Fermi surfaces for particles 
1 and 2 and stabilizes the A-FFLO state. In other words, 
the A-FFLO state is stable near the BCS-BEC crossover 



in cold fermion gases since the spin-diffusion time is long 
enough to conserve the imbalance. This should be con- 
trasted to the superconductors in which the magnetiza- 
tion is not conserved. 

We here comment on the superfluid state in the BCS 
and BEG regimes. In the BCS regime the phase dia- 
gram obtained by the BdG equation (Fig. 1) is reliable 
although the Tc and Ghandrasekhar-Glogston limit are 
decreased. On the other hand, the imbalanced gas in 
the BEG limit is described by the mixture of molecu- 
lar bosons and remaining fermions, and then, the FFLO 
state is not stabilized. 

In this Rapid Gommunication we focused on the su- 
perfluid with broken rotation symmetry. Such a spon- 
taneous symmetry breaking is not allowed in the purely 
one- or two-dimensional system^2ZlMl but is expected to 
be realized in the weakly three-dimensional system. On 
the other hand, it is also interesting to investigate the 
gases in the two-dimensional toroidal trap. Then, the 
rotation symmetry breaking is suppressed by the gapless 
collective mode in the isotropic trap but is produced in 
the anisotropic trap with ^ ujy. Such a giant response 
to the trap anisotropy may manifest the tendency to the 
rotation symmetry breaking as well as the singularity of 
low-dimensional systems. 

In summary, we found that the A-FFLO state is sta- 
bilized in the population imbalanced fermion gases con- 
flned in the toroidal trap. The formation of the R-FFLO 
state leads to the self-one-dimensionalization of the su- 
perfluid and stabilizes the A-FFLO state in the highly 
imbalanced gases. Then, the rotation symmetry is spon- 
taneously broken. The search for the FFLO state in cold 
fermion gases has been fruitless probably because the ex- 
periments were carried out for the harmonically trapped 
gases. It is difficult to detect the FFLO state in the har- 
monic trap since no space symmetry breaking occurs. We 
suggest that the experiment in the toroidal trap will real- 
ize the FFLO state with broken rotation symmetry and 
will obtain the unambiguous evidence for the FFLO state 
which has been searched for more than 40 years after the 
theoretical predictions .'^Isl 

Recently we have become aware of the paper by Ghen 
et al. in which a superfluid state similar to the A-FFLO 
state was investigated in the optical lattice.'^ However, 
the rotation symmetry is not well-deflned in the optical 
lattice. The superfluidity near the BGS-BEG crossover 
has not been investigated. 

We are grateful to T. Mizushima, M. Okumura, Y. 
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Aid for Scientiflc Research from the MEXT (Grants No. 
20029008, No. 20740187, and No. 21102506). Numeri- 
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